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(57) Abstract 

A method of de-interlacing a video signal by conducting three linear filtering operations on the input to produce three filtered signals, 
each linear filtering operation comprising the taking of a weighted sum of pixels; and multiplying together the three filtered signals to 
produce an output video signal. 
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first and second filters; and a second multiplier for multiplying together the 
respective outputs of the first multiplier and the third filter to produce an output 
video signal. 

Advantageously, a filter is interposed between the output of the first 
5 multiplier and the second multiplier. 

Preferably, the apparatus further comprises a linear filter path 
connected with the input terminal, and a combiner for combining the outputs 
of the linear filter path with the output of said second multiplier. 

Suitably, a filter is interposed between the output of the second 
10 multiplier and said combiner. 

The invention will now be described by way of example with reference 
to the accompanying drawings in which: 

Figure 1 is a block diagram of video signal processing apparatus 
15 according to the invention, in the form of a vertical de-interlacing filter; 

and 

Figure 2 is a diagram similar to Figure 1 , illustrating a modification. 

The example will be taken of a de-interlacer and, for reasons of clarity, 
20 a de-interlacer will be described that utilises only vertical information. It will be 
understood that horizontal and temporal information could be included in ways 
which will be immediately evident to the skilled reader. 

In Figure 1 , the new architecture can be seen to consist of two signal 
paths. A linear signal path 10 contains a traditional, vertical, six tap, linear 
25 filter (h lin ) which has a typical sin(x)/x structure. If this were to be used without 
the non-linear signal path it would produce reasonable pictures, but they 
would contain some artefacts due to the interpolation process, notably jagging 
on diagonal and curved edges. 

In the non-linear signal path 20, the output of two four point linear 
30 filters (h n and h 2 ) are multiplied together and passed through a two point linear 
filter (ru). The output of this is then multiplied with the output of a five point 
linear filter (h 5 ). The resulting signal is filtered through another two point linear 
filter (h 6 ) before being added on to the linear path. Although in this case the 



WO 99/60780 




PCT/GB99/01574 



In summary, the new architecture is able to reduce many of the 
artefacts associated with traditional linear interpolation whilst being relatively 
simple to implement. 

Figure 2 illustrates a modification in which the architecture is simplified 
5 through omission of the filters h 4 and h 5 - In other words, the direct product is 
formed of the outputs of filters hi, h 2 and h 3 without intervening filtering of the 
product of the outputs of filters ^ and h 2 . This may under some 
circumstances produce less ideal filter behaviour, but the reduction in 
hardware complexity will often more than compensate. A particular 
10 advantage is that the three remaining filters can all make use of the same 
memory architecture. 

It should be understood that this invention has been described by way 
of example only and that a wide variety of modifications are possible without 
departing from the scope of the invention. Thus, whilst the separation into 
1 5 linear and non-linear paths offers important advantages, such as the option to 
preserve higher bit accuracy in the linear path, it will not always appropriate. 
Similarly, the described use of vertical filters is - as has been explained - 
merely an example. Horizontal, vertical and temporal filters can be employed 
and filters can have one, two or three of these dimensions. Whilst Finite 
20 Impulse Response (FIR) filters will be important, the invention also 

encompasses other forms of linear filter such as recursive filters which include 
the output pixel in the weighted sum. The filters which are to be multiplied 
together need not be of the same category. However, providing three FIR or 
transversal filters with the same filter aperture ensures that in the 
25 multiplication of the three filtered signals, all possible cross products of input 
pixels are made available. 

It will be recognised that although de-interlacing has been chosen as 
an example, filters according to the present invention can be applied to other 
problems in video processing, including composite to component decoding, 
30 enhancement, noise reduction, up and down conversion and standards 
conversion -. 
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Re Item V 

Reasoned statement under Article 35(2) with regard to novelty, inventive step or 
industrial applicability; citations and explanations supporting such statement 

The present application relates to the filtering of video signals. This filtering is for 
example used in de-interlacing, decoding, noise reduction or standards conversion. Bui 
in these processes the filtering is realised with complex non-linear filters. 

The aim of the present application is to have a relatively simple filter architecture. This 
is achieved by the method as claimed in claim 1 and by the apparatus as claimed in 
claim 8. 

The prior art, as represented by US-A-5652620 (D1), neither discloses nor suggests 
the claimed subject-matter: there is no hint in D1 to multiply filtered signals together as 
claimed (on figure 36 non-filtered signals are multiplied by filtered signals). 

The requirements of Article 33(4) PCT are met. 
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Certain defects in the international application 

The features of the claims are not provided with reference signs placed in parentheses 
(Rule 6.2(b) PCT). 



Re Item VIII 

Certain observations on the international application 

Claim 15, which is an apparatus claim, cannot depend on claim 6, which is a method 
claim. 
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first and second filters; and a second multiplier for multiplying together the 
respective outputs of the first multiplier and the third filter to produce an output 
video signal. 

Advantageously, a filter is interposed between the output of the first 
5 multiplier and the second multiplier. 

Preferably, the apparatus further comprises a linear filter path 
connected with the input terminal, and a combiner for combining the outputs 
of the linear filter path with the output of said second multiplier. 

Suitably, a filter is interposed between the output of the second 
10 multiplier and said combiner. 

The invention will now be described by way of example with reference 
to the accompanying drawings in which: 



Figure 1 is a block diagram of video signal processing apparatus 
15 according to the invention, in the form of a vertical de-interlacing filter; 

and 

Figure 2 is a diagram similar to Figure 1, illustrating a modification. 

The example will be taken of a de-interlacer and, for reasons of clarity, 

20 a de-interlacer will be described that utilises only vertical information. It will be 
understood that horizontal and temporal information could be included in ways 

_ which^wilLbe imme diately evident Jo Jhj^skiljgd xeader. ^ 

In Figure 1, the new architecture can be seen to consist of two signal 
paths. A linear signal path 10 contains a traditional, vertical, six tap, linear 

25 filter (h| in ) which has a typical sin(x)/x structure. If this were to be used without 
the non-linear signal path it would produce reasonable pictures, but they 
would contain some artefacts due to the interpolation process, notably jagging 
on diagonal and curved edges. 

In the non-linear signal path 20, the output of two four point linear 

30 filters (hi and h 2 ) are multiplied together and passed through a two point linear 
filter (h 4 ). The output of this is then multiplied with the output of a five point 
linear filter (h 3 ). The resulting signal is filtered through another two point linear 
filter (h 5 ) before being added on to the linear path. Although in this case the 
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In summary, the new architecture is able to reduce many of the 
artefacts associated with traditional linear interpolation whilst being relatively 
simple to implement. 

Figure 2 illustrates a modification in which the architecture is simplified 

5 through omission of the filters h 4 and h 5 . In other words, the direct product is 
formed of the outputs of filters hi, h 2 and h 3 without intervening filtering of the 
product of the outputs of filters hi and h 2 . This may under some 
circumstances produce less ideal filter behaviour, but the reduction in 
hardware complexity will often more than compensate. A particular 

10 advantage is that the three remaining filters can all make use of the same 
memory architecture. 

It should be understood that this invention has been described by way 
of example only and that a wide variety of modifications are possible without 
departing from the scope of the invention. Thus, whilst the separation into 

15 linear and non-linear paths offers important advantages, such as the option to 
preserve higher bit accuracy in the linear path, it will not always appropriate. 
Similarly, the described use of vertical filters is - as has been explained - 
merely an example. Horizontal, vertical and temporal filters can be employed 
and filters can have one, two or three of these dimensions. Whilst Finite 

20 Impulse Response (FIR) filters will be important, the invention also 

encompasses other forms of linear filter such as recursive filters which include 
the output pixel in the weighted sum. The filters which are to be multiplied 
together need not be of the same category. However, providing three FIR or 
transversal filters with the same filter aperture ensures that in the 

25 multiplication of the three filtered signals, all possible cross products of input 
pixels are made available. 

It will be recognised that although de-interlacing has been chosen as 
an example, filters according to the present invention can be applied to other 
problems in video processing, including composite to component decoding, 

30 enhancement, noise reduction, up and down conversion and standards 
conversion -. 
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